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What is claimed is: 

1 . A structure for the utilization of one or more scalability techniques 

operable to enhance one or more digital video frames of a base layer 
of a digital video system, comprising: 

one or more enhancement layers, wherein at least a first enhancement 
layer of the one or more enhancement layers is coupled to the base 
layer and is operable to be coupled to every other enhancement layer, 
and wherein each enhancement layer of the one or more enhancement 
layers comprises one or more enhanced frames of digital video; 

a first sequence of one or more enhanced frames, said first sequence 
operable to be enhanced by selection of one or more scalability 
techniques; and 

for each of the one or more scalability techniques, a mechanism for 
determining a number of the one or more enhanced frames of the first 
sequence that correspond to a scalability technique of the one or more 
scalability techniques. 

2. The structure of claim 1 , wherein two of the one or more scalability 
techniques are SNR scalability and temporal scalability. 
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3. The structure of claim 1 , wherein each enhancement layer of the one 
or more enhancement layers comprises one or more SNR frames and 
one or more temporal frames. 

5 

4. The structure of claim 1 , wherein each scalability technique of the one 
or more scalability techniques is operable to use frames from the one 
or more enhancement layers. 



1 0 5. The structure of claim 1 , wherein a scalability technique of the one or 
more scalability techniques is selected based upon one or more 
criteria, said criteria further comprising one or more of 

a motion function, 
15 a frame separation function, 

a visual quality gain with a SNR scalability function, and 
a bitrate of the enhancement layer function. 

6. The structure of claim 1 , wherein the one or more scalability techniques 
20 is selected in accordance with a comparison of a metric of the one or 

more scalability techniques to a threshold. 
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7. The structure of claim 6, wherein the metric further comprises: 

within an enhancement layer of the one or more enhancement layers, if 
a frame i is a current frame encoded in a previous layer, and p p (i) is a 
5 previously coded frame in the previous layer, the metric of the frame i, 

F (i), is formulated as 



F(i) = aF M (pp(i),i) + pF s (p p (i),i) - ^F SNR (i) + yF R 



where F M (p P (i),i) is a motion function, F s (p p (i),i) is a frame separation 
function, FsnrO) is an SNR visual quality function, F R is a bitrate service 
function, and a, (3, X, and y are corresponding coefficient weights of one 
or more of the motion function, the frame separation function, the visual 
quality gain with the SNR scalability function, and the bitrate of the 
enhancement layer function. 

The structure of claim 7, wherein what scalability technique of the one 
or more scalability techniques to use at frame i is determined in 
accordance with: 



20 



if F(i) < F TH use a first scalability technique of the one or more 
scalability techniques; and 

if F(i) > F TH use a second scalability technique of the one or more 
25 scalability techniques. 

9. The structure of claim 8, wherein the first scalability technique is SNR 
scalability and the second scalability technique is temporal scalability. 
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1 0. The structure of claim 7, wherein as an average motion vector 
magnitude increases, a value of the motion function also increases. 

1 1 . The structure of claim 7, wherein as a frame separation magnitude 
increases, a value of the frame separation function also increases. 

12. The structure of claim 7, wherein the SNR visual quality service 
function is defined as 

FsnrO) = PSNR En hancementLayer(i) - PSNR PrevLaye r(i) 

where a PSNR En hancementLayer(i) is a Peak Signal to Noise Ratio (PSNR) 
value obtained by encoding the current frame i using SNR scalability in 
the enhancement layer and PSNRp revL ayer(i) is a Peak Signal to Noise 
Ratio (PSNR) obtained for frame i in the previous layer. 

1 3. The structure of claim 7, wherein the bitrate service function is a bitrate 
of the enhancement layer. 

14. The structure of claim 1 , wherein if an enhancement frame of the one 
or more enhancement frames is selected and is not an SNR 
enhancement frame, then a copy of an SNR enhancement frame from 
a previous layer is replicated to a current layer at the same time 
instance as in the previous layer. 
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1 5. A structure for the utilization of SNR scalability and temporal scalability 
operable to enhance one or more digital video frames of a base layer 
of a digital video system, comprising: 

one or more enhancement layers, wherein at least one enhancement 
layer of the one or more enhancement layers is coupled to the base 
layer and is operable to be coupled to every other enhancement layer, 
and wherein each enhancement layer of the one or more enhancement 
layers comprises one or more temporal enhanced frames and one or 
more SNR enhanced frames; and 

a first sequence of one or more enhanced frames, said first sequence 
operable to be enhanced by selection of the one or more SNR 
enhanced frames and the one or more temporal enhanced frames; 

wherein the one or more SNR enhanced frames and the one or more 
temporal enhanced frames are operable to be selected based upon 
one or more criteria, said criteria comprising one or more of 

a motion function, 

a frame Separation function, 

a visual quality gain with a SNR scalability function, and 
a bitrate of the enhancement layer function. 
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16. The structure of claim 15, wherein a metric is operable to select the 
one or more SNR enhanced frames and the one or more temporal 
enhancement frames, said metric comprising: 

within an enhancement layer of the one or more enhancement layers, if 
a frame i is a current frame encoded in a previous layer, and p p (i) is the 
previously coded frame in that layer, the metric of the frame i, F (i), is 
formulated as 

F(i) = ctF M (Pp(i),i) + PF s (p p (i),i) - ^F SNR (i) + yF R 

where F M (p p (i),i) is a motion function, F s (p p (i),i) is a frame separation 
function, F S nr(i) is an SNR visual quality function, F R is a bitrate service 
function, and a, (3, X, and y are the corresponding coefficient weights of 
one or more of the motion function, the frame separation function, the 
visual quality gain with the SNR scalability function, and the bitrate of 
the enhancement layer function.. 

17. The structure of claim 16, wherein a scalability technique to use at 
frame i is determined by 

if F(i) < F TH use a SNR enhancement technique; and 
if F(i) > Fth use a temporal enhancement technique. 

18. The structure of claim 16, wherein as an average motion vector 
magnitude increases, the value of the motion function also increases. 
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1 9. The structure of claim 1 6, wherein as a frame separation magnitude 
increases, the value of the frame separation function also increases. 

20. The structure of claim 1 6, wherein the SNR visual quality service 
function is defined as 

FsNR(i) = PSNR E nhancementLayer(i) - PSNRp reV Layer(i) 

where a PSNR En hancementLayer(i) is a Peak Signal to Noise Ratio (PSNR) 
value obtained by encoding the current frame i using SNR scalability in 
the enhancement layer and PSNR Pre vLayer(i) is a Peak Signal to Noise 
Ratio (PSNR) obtained for frame i in the previous layer. 

21 . The structure of claim 16, wherein the bitrate service function is the 
bitrate of the enhancement layer. 

22. The structure of claim 1 5, wherein if an enhancement frame of the one 
or more enhancement frames is selected and is not an SNR 
enhancement frame, then a copy of an SNR enhancement frame is 
replicated from a previous layer to a current layer. 
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23. A method for the utilization of one or more scalability techniques 

operable to enhance one or more digital video frames of a base layer 
of a digital video system, further comprising: 

coupling at least one enhancement layer of one or more enhancement 
layers to the base layer, wherein each enhancement layer of the one or 
more enhancement layers is operable to be coupled to every other 
enhancement layer of the one or more enhancement layers and 
comprises one or more enhanced frames of digital video; 

enhancing a first sequence of one or more enhanced frames by 
selection of one or more scalability techniques; and 

for each of the one or more scalability techniques, determining a 
number of the one or more enhanced frames of the first sequence that 
correspond to a scalability technique of the one or more scalability 
techniques. 

24. The method of claim 25, wherein selection of the one or more 

scalability techniques is performed in accordance with a comparison of 
a metric of the one or more scalability techniques to the threshold. 
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25. The method of claim 26, wherein the metric further comprises: 

within an enhancement layer of the one or more enhancement layers, if 
a frame i is a current frame encoded in a previous enhancement layer, 
5 and p p (i) is a previously coded frame in the previous enhancement 

layer, the metric of the frame i, F (i), is formulated as 



F(i) = aF M (Pp(i),i) + f3F s (p p (i),i) - ^F SNR (i) + yFr 

10 where F M (p P (i),i) is a motion function, F s (p p (i),i) is a frame separation 

function, F S nrO) is an SNR visual quality function, F R is a bitrate service 
function, and a, p, X, and y are corresponding coefficient weights of one 
or more of the motion function, the frame separation function, the visual 
quality gain with the SNR scalability function, and the bitrate of the 

15 enhancement layer function. 

26. The structure of claim 25, wherein if an enhancement frame of the one 
or more enhancement frames is selected, further comprising: 
replicating a copy of an SNR enhancement frame from a previous'layer 

20 to a current layer. 

27. A method for the utilization of SNR scalability and temporal scalability 
operable to enhance one or more digital video frames of a base layer 
of a digital video system, comprising: 



25 



coupling at least one enhancement layer of one or more enhancement 
layers to the base layer, wherein each enhancement layer of the one or 
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more enhancement layers is operable to be coupled to every other 
enhancement layer of the one or more enhancement layers and 
comprises one or more temporal enhanced frames and one or more 
SNR enhanced frames; and 

enhancing a first sequence of one or more enhanced frames by 
selection of the one or more SNR enhanced frames and the one or 
more temporal enhanced frames; and 



10 selecting the one or more SNR enhanced frames and the one or more 

temporal enhanced frames based upon one or more criteria, said 
criteria comprising one or more of 

a motion function, 
1 5 a frame Separation function, 

a visual quality gain with a SNR scalability function, and 
a bitrate of the enhancement layer function. 

28. The structure of claim 30, wherein if an enhancement frame of the one 
20 or more enhancement frames is selected, replicating a copy of an SNR 

enhancement frame from a previous layer to a current layer. 
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